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THE COMPUTER -CONTROLLED OCULOMETER: 
A PROTOTYPE INTERACTIVE EYE MOVEMENT TRACKING SYSTEM 



By 

Matthew J. Hillsman, 

R, Hade Williams and John S. Roe 

SUMMARY 

One kind of eye movement tracking device which has great 
potential is the digital computer-controlled Oculometer, an 
instrument which non-invaaively measures point of regard of the 
subject, as well as pupil diameter and blink occurrence In 
conjunction with a computer-generated display which can change 
in real time as a function of the subject's eye motions, the 
computer-controlled Oculometer makes possible a variety of 
interactive measurement and control systems- practical applica- 
tions of such schemes have had to await the development of an 
instrument design which does not inconvenience the subject, and 
which conveniently interfaces with a digital computer (see Ref, 1) 

This report describes an Oculometer subsystem and an eye- 
tracking/controi program designed for use with the PDP-6 computer 
of the M.X.T* Project MAC Artificial Intelligence Group. The 
Oculometer electro-optic subsystem utilizes near-infrared light 
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reflected specularly off the front surface of the subject's 
cornea and diffusely off the retina, producing a bright pupil 
with an overriding corneal highlight. An electro-optic scanning 
aperture vidissector within the unit, driven by a digital eye- 
tracking algorithm programmed into the PDP-6 computer, detects 
and tracks the centers of the corneal highlight and the bright 
pupil to give eye movement measurements. A computer-controlled, 
moving mirror head motion tracker directly coupled to the vidis- 
sector tracker permits the subject reasonable freedom of move- 
ment. Various applications of this system, which arc suggested 
by the work reported here, include: (a) using the eye as a con- 
trol device, (b) recording eye fixation and exploration pat- 
terns, (c) game playing, (d) training machines, and (e) psycho- 
physiological testing and recording. 



INTRODUCTION 

In some measurement and control situations involving human 
vision it appears advantageous to monitor, or in some manner 
utilize, certain eye movements. The Oculometer is an instrument 
which was developed by the Honeywell Radiation Center under Con- 
tract WAS 12-531 for the NASA Electronics Research Center for the 
purpose of investigating problem areas involved with the above. 



The instrument simultaneously and dynamically measures pupil 
centroid position (eye position) , pupil size, eye optical axis 
pointing direction and blink occurrence, when the instrument is 
operating the subject's eye is irradiated by a collimated source 
of near-infrared energy. The near-infrared radiation reflected 
from the subject's corneal and retinal surfaces is detected by a 
scanning aperture image dissector (vidiBSector) which is sensi- 
tive to the source output (see Pig. I}- Both the near-infrared 
source and vidissector are located within the Oculometer electro- 
optical unit and share the same optical axis. Eye movements are 
electronically derived fran measurements of the vidissector out- 
put signals, which include information about the position of the 
corneal reflection relative to the centroid of the pupil-iris 
boundary. This latter information is used to determine eye 
pointing direction (see Fig. 2), By using near-infrared tech- 
niques for measuring eye movements, the Oculometer presents vir- 
tually no interference to normal vision. The outputs of the 
instrument are real-time electrical signals directly proportional 
to the measured eye movements. 

Two different laboratory prototype models of the Oculometer 
were designed and fabricated for NASA. One model was a proximate 
instrument (Ref. 2) and the other a remote version (Ref. 3). The 
feasibility of the Oculometer concept was successfully demonstrated 
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with these instruments; however, being developmental units their 
operational and measurement capabilities were somewhat limited. 

With the Proximate Oculoraeter, which was the first version 
of the instrument to be built, the user observed the field of 
view through a 7-cm diameter dichroic beamsplitter attached to 
the instrument's optical head. This particular optical configura* 
tion restricted subject head motions, accommodating only a 
±1.3- cm lateral and longitudinal rango of eye positions* Never- 
theless, both horizontal and vertical angular eye pointing direc- 
tions of up to ±15° and pupils of 2 -mm to 9-mm diameter could be 
measured with accuracies of approximately 0,5° and 0.2 mm respec- 
tively. Blinks were detected and measured as they occurred* 

The Remote Oculometer, which was built some months after the 
proximate unit, was a more versatile instrument. The user was 
allowed a +6. 3- cm lateral and +2.5-cm longitudinal range of head 
motions and accompanying eye positions at a distance of approxi- 
mately 1 meter from the optical unit, and was not required to 
view the scene through an intervening aperture, such as a beam- 
splitter. This method of operation was accomplished by using a 
servo-controlled moving mirror system to automatically track eye 
position as the head moved. With this latter system lateral head 
movement rates up to 25 cm/sec could be followed. The remote 
version of the Oculconeter also retained the other eye movement 



measurement features and accuracies described for the proximate 
unit. 

Proposed MASA plans for future Oculometer work included 
investigating the feasibility of using a small digital computer 
to replace the existing analog— digital hybrid electronic control 
unit (see Refs. 2 and 3). This latter unit suffered from elec- 
tronic instability problems over long periods of operation and 
was not amenable to control program change since it was a hard- 
wired system. The digital computer technique of Oculometer con- 
trol was expected to allow electronically stable and simplified 
instrument operation, ease of control program change, and con- 
venient calibration of output signals. Also, with digital com- 
puter control, eye characteristics peculiar to a specific user 
and common subject-to-subject eye variations could be readily 
dealt with. In addition, the digital computer could be flexibly 
programmed to allow selected visual functions of the subject to 
control external devices, if desired- 
Based on the proposed NASA plans, the M.I.T. Project MAC 
Artificial Intelligence Group was contracted by the NASA Elec- 
tronic Research Center to investigate the feasibility of a digi- 
tal-computer-controlled Oculometer. This work, the results of 
which are reported here, involved the development of an on-site 
(M.I.T. Project MAC) Oculometer measurements facility, as well 



as several specialized computer programs and I/O interfaces 
suitable for use with an Oculometer electro-optical unit and the 
M*I.T. Project MAC PDP-6 computer- An Oculometer electro-optical 
unit with its associated electronics (power supplies and A-D 
hybrid control unit) was provided as government-furnished equip- 
ment. The A-D hybrid control unit section of the Oculometer 
electronics was disabled for the performance of this work since 
it was to be replaced by the PDP-6 computer, the I/O interface, 
and the control programs. At a later date during the contract 
period the original Oculometer power supplies were replaced with 
an Unproved unit (see Appendix B) * The computer programs gener- 
ated during the performance of the work reported here were 
developed by and modeled in part on earlier work of Geffner 
(see Ref- 4) . 

THE COMPUTER- CONTROLLED OCULOMETER SYSTEM 

Basic Description of a Prototype 
Interactive Eye Movement Tracking System 

The prototype interactive eye movement tracking system devel- 
oped under this contract consisted of the following components: 

a) The Remote Oculometer electro-optical unit and power 
supply r 

h) The PDP-6 computer (a PDP-10 computer also was avail- 
able and could be used interchangeably with the PDP-6 without 



program modification); 

c) The I/O interface circuitry; 

d) The Oculometer eye-tracking/control programs: 

e) An x,y video display; 

f) A TTY or video display-type I/O terminal; 

g) A high-speed line printer. 

The basic interconnections of this particular system are 
shown diagrammatically in Fig- 3. The experimental apparatus 
described here is unique in that it is unlikely to be duplicated 
elsewhere in this particular configuration. However, the flexi- 
bility of the digital computer approach to eye tracking is such 
that the programs developed here could be rewritten without 
excessive difficulty for other suitable computer facilities. For 
complete eye-tracking system operation it would of course be 
necessary to obtain an Oculometer electro-optical unit and power 
supply and develop the necessary I/O interface circuitry. 

Oculometer Electro-Optical Unit and power Supply 

The Oculometer electro-optical unit and power supply used 
in this work has been described in Refs. 2 and 3. Basically, 
the Oculometer electro-optical unit core ists of the following: 

a) A near-infrared radiation source and optical assembly 
used to illuminate the pupil and cornea of the subject's eye; 
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b) A dual-axis moving mirror optical assembly (capable of 
being disabled and operated in a stationary mode) for tracking 
fjroas head-eye motions in a lateral plane perpendicular to the 
optical axis; 

c) A scanning aperture image dissector (vidissector) and 
optical assembly used to acquire and track the pupil and corneal 
Images of the sugject, 

A line drawing of this unit is shown in Pig. 4. A detailed 
description of a modified Oculometer power supply appears in 
Appendix B. 

Oculometer/Computer System Environment 

The computer environment of the prototype interactive eye 
movement tracking system was the Incompatible Time-Sharing Sys- 
tem (ITS) of th* M.I.T. Project MAC Artificial Intelligence 
Group. The ITf system consists of the following major components; 

a) One PDP 10 computer; 

b) One PDP 6 computer; 

c) One 256K, 36-bit word, mass core memory; 

d) Four BM, 9-bit character, disc memory units: 

e) Peripheral terminals and I/O interfaces. 

However, the eye movement tracking system was not run in a time- 
sharing mode. The mode of operation used in this work was as 

follows: 

11 



12 




a) The Oculometer eye-tracking/control programs were loaded 
into the mass core memory from the disc memory unit. That opera- 
tion was accomplished through the PDP-10 computer and a display- 
type I/O terminal located near the Oculometer electro-optical unit. 

b) Fran the above, the tracking/control programs were sub- 
sequently loaded into the 16K, 36-bit word memory of the PDP-6 com- 
puter, again using the I/O terminal located near the Oculometer 
electro-optical unit* 

c) Oculometer operation depended only upon the PDP— 6 computer 
once its memory was loaded. Program changes/inputs to the ocu- 
lometer/PDP-6 system were buffered through the PDP-10/mass core 
memory system from the Oculometer I/O terminal* This was the only 
concession made to the ITS system during the Oculomctcr/computer 
system operation. Pig. 5 shows the ccroplete system block diagram. 

Physical Arrangement of the Oculcmeter/computer system 

The physical arrangement of the Oculomoter/ccroputer system is 
shown in Figs. 6, 7, 8 and 9, The ocuJometer electro-optical unit, 
X,Y video display, display-type I/O terminal, and I/O interface 
circuitry were located in the M.X.T. project MAC A.I. Group Bye 
Tracking Laboratory. These components of the system were coupled 
by approximately 50 ft of coaxial cable to the PDP-6 computer which 
was located nearby. Fig. 10 is a line drawing depicting the loca- 
tion of the subject relative to the position of the components of 

13 
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Figure 5 COMPUTER-CONTROLLED OCULOHETER SYSTEM (DETAILED) 
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the eye-tracking system which wore located in the Eye Tracking 
Laboratory* 

To operate the* eye tracking system the subject first was 
comfortably seated at the proper position in front of the Ocu- 
lomotor olectro-optical unit. The operator would then command 
the PDP-6 with the routine eye- tracking/control programs through 
the x/o terminal and proceed with the experiment. Either eye of 
the subject could be used for eye tracking experiments, and the 
operator and subject often were the same person. 

Oculometer Electro-Optical Unit/X,Y Video Display Hardware 

The Oculometur/vidM display hardmre performs three 
functions: 

a) It enables the eye-tcack/cos:'-rol program to measure 
(at approximately 300 microseconds per point) the brightness of 

any point or series of points in the field of view of the Ocu- 
lometer vidissector (normally a point in the pupil or on the 

cornea of the subject's eye). 

b) It enables the Oculometer (vidissector) field of view to 
change by repositioning the dual-axis head/eye tracking mirrors, 
either under manual or mirror-track program control. 

c) It rnabieH *-he vid*K» display program to write a point 
or a series of points (to constitute a line drawing) on the X,Y 

20 



video display. 

The hardware is linked to Che computer via the I/O bus by the 
I/O interface circuitry. This circuitry consists of level con- 
verts (see Fig, 5) (the I/O bus uses DEC levels of -3 V and V: 
the Oculometer electro-optical unit logic uses TTL levels of 
+3 V and V), Oculometer control (see Fig- 11), and the serial 
I/O interface (see Figs, 12, 13, 14 and IS). The serial I/O 
interface (see below) recognizes device numbers 544, 550 and 554. 
These devices specify dual-axis mirror, vidissector, and video 
display deflections respectively. The larger part of the inter- 
face circuitry is at the I/O bus itself. The interface circuitry 
serializes data for the above three devices and sends it via one 
coax cable to the serial I/O interface remote, which is located 
with the Oculometer electro-optical unit. The I/O interface cir- 
cuitry also does the final decoding and loading of the proper 
MC's. The Oculometer control recognizes device numbers 534 and 
540; the latter device starts the (eye) point brightness measure- 
ment, while the former is used to input the result of the measure- 
ment to the eye-track program for processing. The computer word 
data format used in the operation of the above is shown in Fig. 16. 

Operation of the Oculometer/video display hardware is as 
follows: 

a) To measure the brightness of an eye point in the vidis- 

21 
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vidissector field of view, tho coordinates of the desired point 
are loaded (by the eye-track program) into the DAC's which drive 
the vidissector deflection amplifiers- The video signal developed 
by the vidissector as a result of the deflection-detection func- 
tion is time-averaged by an integrator in an integrator-threshold 
detector (see below) to reduce its noise content. The final 
result is made available to the I/O bus by the I/O interface, 
which may request an interrupt when data is ready for processing. 

b) The head/eye tracking mirror servos 1 command inputs may 
be taken either from manual (or off-line) control potentiometers 
(for static control) or from two DAC's loaded by the mirror-track 

program (for on-line dynamic control). However, during the major 
portion of this work, electro-mechanical difficulties experienced 
in the computer-control mode of operation of the tracking mirror 
servo assembly (see Ref. 3) (resulting from inefficient torque 
motors) forced the abandonment of its operation, other than under 
manual control* 

c) The display program loads DAC's which drive the video 
display deflection amplifiers and cause the display beam to be 
positioned at the desired on the video display, the beam is 
deflected off screen. 
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Operation of the Serial I/O Bus Interface 
A serial interface has been constructed to drive the Ocu- 
lometer. This device can also connect to additional transceivers 
for remote i/o transmission- The device consists of a master 
transceiver at the computer and one or more slave transceivers 
which connect to the master through two coaxial cables. 

The line from master to slave sends self-clocking bits at 
10.5 mhz. A zero is sent as a 25-ns pulse- A one is 75 ns long. 
The leading edges of both ones and zeros are in the same phase 
and occur every 95 ns. when the line is idle a stream of ones 
is sent continuously. If an output command is given (CONO 554 
550 or DATAO 554 550 554) a 42-bit message is sent. It consists 
of a zero, the state of I0S9, the state of I0S9, a bit to indi- 
cate CONO (0) or DATAO (1), two ones, and 36 bits of data (bit 
35 first) . 

An input command is initiated with a CONO 554. The 42 bits 
sent are a zero, IOB20, I0B19, I0B1Q, and 38 zeros. The lines 
from slaves to master are active-low and are all or-ed together. 
The addressed slave sends its data low-order bit first during the 
last 36 bits of the message. The data can then be read into the 
computer with DATAI 554. 
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Operation of the Integrator-Theshold Detector 

The integrator-threshold detector (Fig. 17) (and power supply 
Fig. 17a), together with the counter (a part of the Oculometer 
control), performs the actual eye-point brightness measurement. 
When an eye-point measurement is started (after the desired vidis- 
sector deflection has occurred) an integrator sums the vidissector 
anode current until the sum reaches a manually adjusted threshold, 
T. This sum at any instant during integration is proportional to 
the total number of photons incident on the selected port of the 
vidissector photocathode since integration was begun; the actual 
value of the sum is 



/< 



q * A 

(output of integrator) = V int = _E 5L, 

c int 



where q a ■ 1.6 x 10"**' coulombs, i - photocathode quantum effi- 

o 
ciency (~1.5% at 7500 A), ^ * vidissector electron multiplier 

gain f-1.4 x 10 ) , and C* c = integrating capacitor (-27 pf ) . 
Thus, for this system, V > fc B( 1.25 x 10 volts/photon, or if we 
define I - 1/V, I S 600 photons/volt. Since the arrival of 
photons, their conversion by the photocathode, and the instan- 
taneous value of the multiplier gain are all random processes 
obeying Gaussian statistics, the standard deviation (i.e. probable 
error) of the integral / (output of integrator) is _. / , 
where N/t is the number of photons observed as of time ; ._ 
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during the integration. Because the threshold T corresponds to 
a certain number (n t = IT) of photons, the accuracy of the mea- 



surement is proportional to v'Tr in this device 10 rov < T < 5 V 
"*8 < N < 3500. Thus, available signal-to-noise ratios are 
3.5:1 to 63:1; any value in this range may be chosen by the 
experimenter to optimize the inherent trado-off of measurement 
accuracy vs. speed of operation. 

The integrator is reset and started by the Oculometer con- 
trol logic via one coaxial cable. When the logic level on this 
cable is low ("false") the integrator is reset; this level is 
stretched by 1.4 us to ensure complete reset. When the level is 
high ("true") the integrator is allowed to run, it returns to 
the control logic level via another coaxial cable which is high 
("true") when the integrator has been started but not yet reached 
the threshold, i.e. V int < V , and low ("false") at all other 
times. The counter, located on the Oculometer control card, times 
the "true" interval in increments of 47.6 ns. Since the counter 
has 12 bits, the longest integration time measurable is 
47.6 x 2 = 194 us. If the integration takes longer, the 
counter overflows, measurement stops, and the overflow flag is 
set in the returned value. This tells the program that the point 
wc ■ dimmer than N^/194 x 10 6 photons/sec at the photocathode. 
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Basic Description of the 
Oculometer Eye-Tracking/Control Program 



The body of the Oculometer eye-tracking/control program con- 
sists of thirty-two (32) pages of standard line printer listing 
written in MIDAS, the machine language assembly system. The entiri 
program utilizes approximately 6K words of the 16K-word core 
memory of the PDP-6 computer. The following is a summary of this 
program, including page number (s) , routine title(s), and a brief 
description of the indicated routines: 

Program 

Page (a) Routine Title (s) do^cl lpLiun 



1-2 



CIB 



Constants and variables 

TTY or display I/O terminal input 
routine 



4-5 



SCRTST 



INIT 



More constants and variables 

Coarse raster display of pupil/ 
corneal intensity seen by the 
vidissector 

Initialization roit ine 



7-8 



9 



10 



11-12 



RASINI, ROSINI 



CIBINI 



13 



ETTRAK 



BLINK 



PUPTK 



Subroutines which generate succes- 
sive X,Y coordinates of a raster 

Subroutines which generate succes* 
sive X,Y coordinates of a circle 

Main eye- track routine 

Routine which handles various con- 
tingencies when eye-tracking faili 

Pupil tracking routine 
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14 


CORTK 


15 


PUPGET 


16 


SHAPS 



Corneal tracking routine 

Pupil acquisition routine 

Detailed raster display of pupil/ 
corneal intensity seen by vidis- 
sector 





CORGET 




17 


VIDI, VID 




le 


READVS 




19 


SAVE, WRITE, 


RUN 


20-21 


REPIAY 





22 

23 

24 



25 



INTEG 

FAST 
CIRC 



DPYSUB 



Corneal acquisition routine 
Vidissector input routines 

Converts vidissector anode output 
values to light intensities 

Main loop of program 

Routines to replay (on the video 
display) tracking patterns that 
had been saved during actual eye- 
tracking experiments 

Routine for doing moving average 
smoothing of eye-track valu©6 

Fast mode routine 

Plots a circle on the display in- 
dicating the present fixation point 
of the eye; also does the saving 
for later replay if in that mode 

Routine that display all odd points 
of eye fixation that have been 
saved 
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28 



DISPIR ,, 
FOCUS 

FOSAVE 



Display subroutines 

Displays pupil/corneal intensities 
along the horizontal (x) coordi- 
nate, through the corneal highlight 

Saves then displays last "FOSVNO" 
FOCUS lines 



34 



29 TRANS Converts vidissector coordinates 

to cooresponding display coordi- 
nates 

CALIB Five-point calibration routine 

30 CALIST Used by calibration routine 

31-32 — Various back-up routines for 

responding to teletype input 

While all the above routines are essential to the operation 
of the Oculometer system developed here, the routines entitled 
EYTRAK, BLINK, PUPTK, CORTK, PUPGBT, CORGET, INTEG and CALIB con- 
tain the heart of the eye-tracking section of the program. The 
remaining routines are utilitarian or parametric in nature and 
are primarily concerned with general system operation and testing. 

The Oculometer eye-tracking/control program has a number of 
modes of operation as described above. These are commanded from 
either a TTY or display-type I/O terminal. Commands consist of 
double characters which appear on page one (1) of the program 
listing, page two (2) lists the meanings of these character sets. 
The program is arranged to interrupt its computation whenever a 
character set is inserted by the operator. The character set 19 
tested against the list of possible program commands. The set is 
ignored if not meaningful; otherwise it is processed immediately. 
The ccsnmands are so chosen that processing corresponds simply to 
a jump to an appropriate routine, from which computation proceeds. 
Those commands are basically of two types: (1) those which are 
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used to change the value of parameters which are involved in the 
operation of a program, and (2) those which switch the program to 
a different operation routine. After completion of the first type 
of command the program continues from its point of interruption. 
However, the program does not return to its interruption point 
after responding to the second type of command. 

Description of the Eye-Tracking/Control program Variables 

The following is a description of the program variables used 
by the EtfTRAK, BLINK, PUPTK, CORTK, PUPGET, CORGET, INTEG and 
CALIB routines: 

a) Input Variables 

TIMLIM Number of cycles to be spent in eye-track 
FASTSW / if in fast mode 

b) State Variables 

CORFND / cornea "seen 41 on last entry 

PUPFND * pupil 'seen" on last entry 

PUCHA tells PUPTK the state of PUPFND 

PLAGE holds number of BLINK or STINK cycles left to try 

MODE state ETTRAK is in, as follows: 

Relevant Program Value of Mode Meaning 

BLINK, BLXNKl, 3 Pupil, cornea in track; keep 

BLINK2 tracking {PUPTK and CORTK) 

2 Pupil in track, cornea lost; con- 

tinue to track pupil while trying 
to acquire cornea (CORGET) 
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Both pupil and cornea lost; assume 
a blink, i.e. continue to try 
tracking pupil in hopes it will be 
in same place when eyelid opens. 
Do this BLMAX times. 



STINKY, 
ST INK 2 



Both pupil and cornea lost and it 
does not seem to be a blink, i.e. 
we have lost track and need to go 
looking for the pupil. First 
search field of view of vidissector 
(PUPGET) . Do this CMAX times. 



RINKY 



-1 



Mode zero failed, pupil not with- 
in field of view, so start moving 
mirrors. First try a spiral out 
from last known position of pupil r 
do once. 



DINKY 

LOSTS 
BLINKS 
BLMAX 
CMAX 



WITEAV, 
PUPBUC. 
CORBUC 



-2 



Mode -1 failed. Move mirrors over 
their whole range in a coarse 
raster. Do this until acquisition. 



/ lost eye completely (modes 0, -1, -2) 

^ loss of track, assume blink (mode 1) 

number of cycles to assume blink 

number of cycles to search before resorting to moving 

the mirrors 

CORVAL 

Corneal highlight 

■'■ '■ i'" 1 " . ! 

•pupil 



Intensity 



WITEAV 
PUPBU 



3 




(Pupil/corneal intensity along horizontal (x) coordi- 
nate, through the corneal highlight) 



PUPX, 
PUPY 

PUPRAD 



X,Y coordinates of center of pupil 
Radius of pupil 
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CORAX, 
CORAY 

CORRAD 



X,Y coordinates of center of corneal highlight 
Radius of cornea 



CORX, 
CORY 



X,Y coordinates of center of corneal highlight 
relative to center of pupil 



c) Local variables 



TCT 



Number of cycles we have been in eye-track this time 



WITEAV (Pi) X Points actually read by vidis- 

sector. Points define pupil and 
Points stored for computation:) corneal highlight boundaries. 



PAVAL (P2) 
PBVAL (P3) 
PCVAL (P4) 
CORVAL (P5) 
AVAL <P6) 
BVAL {P7J 
CVAL (P8) 
DVAL (P9) 




(P2) 



(P9) 

(P6). .* 
(PB)- 



(P5) 
(P3) 



(PI) 



- <P4) 

These intensity values are used in 
calculation of PUPX, PUPX... 
(see State Variables). 



PA 

PB 
PC 
PD 
PE 



MXZ 
MYZ 

MXR 
HYR 



CORX, CORY at the five points on the X,Y video display 
used to calibrate the Oculometer 




( 



X,Y video display 
horizontal field of view =2 12.5° 
vertical field of view a 9,5° 



) 



Computed by CALIB (the calibration) and used to trans- 
form a given CORX, CORY pair into a point of regard 
(see INTEG - TRDAB) . 



SCRKAX 



Maximum screen coordinates (0 = min) 
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In CALIB: 4*PEy+PA x +PB x +PC v +PD x 
MXZ - i 

a 

4*PE„+PA +PB..+PC +PD 



MYZ «■ 

5CRMAX*2 



y+PA/PB y +PC y +PD y 



KXR 



MYR 



PA X +PB X -PC X -PD X 

SCRWVX*2 
PA y +PD y -PB y -PC y 



in TRQABt 



POR = (CORX-MXZ)MXR 



x 



POR^ = (CORY-MYZ)MYR 
POR * point of regard relative to center of screen 



Initialization of the 
Oculometer Eye-Tracking/Control Program 



Two types of initialization must occur prior to operating 
the computer-controlled Oculometer system. They are defined as 
program initialization and tracking initialization. Program ini- 
tialization generally need happen only once — when the system 
program begins to be executed. It is concerned with loading the 
cctnputer memory with the eye- tracking /control program, opening 
the channels for the several I/O devices used, and preparing to 
process TTY or l/o terminal inputs. Tracking initialization 
refers to identifying and localizing the subject's eye in the 
vidissector field of view. This procedure is accomplished 
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through the use of the SCRTST and CALIB routines* After the 
CALIB routine is accomplished the program proceeds to the EYTRAK 
routine and normal system operation, barring any tracking mal- 
functions. Should a tracking malfunction occur after CALIB, the 
routines SCRTST and CftLIB can be repeated. 

Oculomotor Bye-Tracking Algorithm 

The Oculometer eye-tracking algorithm is concerned with the 
following problem: given a two-dimensional image of the sub- 
ject's eye, consisting of a bright pupil with an overriding cor- 
neal highlight, which a) is focussed on the vidissector photo- 
cathode, b) oan move within the vidissector field of view (as 
with head motion), and c) can be occluded so as to momentarily 
vanish (as in a blink), repeatedly determine, with high cycle 
rate, the position of the center of the pupil in the vidissector 
field of view and the position of the center of the corneal high- 
light relative to the center of the pupil. 

The requirement of high cycle rate (to insure tracking of 
swift eye movements) demands the utmost of simplicity in the 
tracking algorithm. Also, the natural, dynamic geomtotry of the 
human eye makes it necessary to deal with situations when the 
pupil is noncircular (as is the case when the upper eyelid is 
partially lowered and obscures the upper portion of the pupil). 
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The algorithm evolved here appears to meet the tracking 
requirements. 

The (EYTRAK) program organization itself is unusual; when 
tracking the eye, it operates as a closed subroutine, calling a 
pupil tracking subroutine (PUPTRK) and a cornea tracking subrou- 
tine (CORTRK), then exiting to its calling procedure. This code 
takes about five pages. PUPTRK and CORTRK are each one page 
long, the rest being utility routines. 

The bulk of the code is a rather elaborate collection of 
contingency routines to be used when either PUPTRK or CORTRK fail. 
This may happen when initially acquiring the pupil image (PUPGET), 
acquiring the corneal image (CORGET) , or in the event of blinks, 
sudden movements or changes in light levels (BLINKY, BLIHK, etc.). 
Although the tracking program described here was originally 
intended to be exactly analogous to the tracking program of the 
previous analog-digital hybrid electronics version of the Ocu- 
loraeter, it makes some concessions to continuous techniques of 
the latter. In particular, the tracking algorithm of the pre- 
vious version of the Oculometer involved gating the anode current 
of the vidissector (less a bucking voltage) into several differ- 
ent integrators with sign of either +1 or -1 {see Ref. 2). The 
PUPIL x-dimension loop is illustrative. During the circular scan 
of the pupil two intervals were designated as PUPIL x times, as 
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as indicated belowi 




X 2 time 



PUPIL Xj extended from 67.5° to 135°; PUPIL X2 time covered the 
symmetrically opposite interval. The pupil bucking voltage 
{PUBUCK in EtfTRAK) was selected to be the mean of the pupil inten- 
sity (white sense) (A) and the background intensity (black sense) 

(B) • The PUPIL x value (PUPX) was derived as PUPX — PUPX + 
pupil x± 



f i 



(anode voltage - pupil buck voltage) dt - 



pupil x 2 



(anode voltage - pupil buck voltage) dt. Thus, if 
the circular scan (centered arcund (PUPX, PUPY) ) coincided exactly 
with pupil-iris boundary, the anode voltage value would be exactly 
the mean of dark value and light value (^PUBUCK), both integrals 

= 0, and PUPX would be correct. A displacement of the scan to 

/ X l f X 2 

<0 and / ' )0, resulting in a left- 

ward correction of PUPX* Similarly , a left scan displacement 

would result in a right correction- This is indicated below: 



sss< 




f y anode voltage 
< PUBUCK 



j-xi <0 



/ right scan 
^r displaced 

anode voltage y 
PUBUCK f Xl > 



/ 
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Note that, in general, this correction is not linear with dis- 
placement, as indicated belows 



/■ 



- pupil diameter 



- V,A,R, 



correction to X 



complete loss of 
track 




h- 



+ vidissector 
aperture radius 



+ pupil 
diameter 



scan 
displace- 
ment 



X scan correction (Y scan correct) 



The correction is pseudolinear for a range nearly the 
diameter of the vidissector aperture, but gives only a displace- 
went direction for greater errors. This abbreviated linear range 
is a serious drawback. If the Y scan value is also incorrect, 
even the saturated range is shorter* This property was also a 
serious drawback of the scanning algorithm of the previous 
analog-digital hybrid system. 

In the previous system there was a pupil x tracking loop as 
described, and a pupil y tracking loop, which used only the 
bottom of the eye image (to permit the eyelid to close down over 
the pupil slightly), as indicated on the following page: 
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white 

black 

sense . 

112h C 



At the end of the 3/4 circular scan there was a black sense 
time (B) . At the beginning of the 3/4 circular scan there was a 
white sense time (A)* Thus, 

/pupil y 
(anode voltage - pupil buck voltage) dt 

and 

/white sense (A) 
(anode voltage - pupil buck voltage) dt 



/ 



black sense (Bj 

(anode voltage - pupil buck voltage) dt . 



Similarly, the pupil radius is calculated as 

/whole scan 
(anode voltage - pupil buck 
voltage) dt . 

Although the tracking equations are represented above as 
discrete substitutions occurring once per cycle (as they are in 
the present EVTHAK program) the previous version of the tracking 
program actually updated each variable value continuously during 
the whole scan- This had the annoying effect that the pupil 
radius "alue just after the PUPIL X x interval would be decreased 

44 



if the tracking were right-displaced and increased if track were 
loft-displaced. Thus, the scan was seldom quite exactly circular, 
an effect minimized by scaling the correction factors downward by 
a constant multiplier (a potentiometer) to decrease loop gain. 
This reduced output jitter, but it reduced response rates also. 

The present program PUPTRX works substantially as described 
above, but the 3/4 circular scan has been replaced by a three- 
point discrete scan? the intervals replaced by sums; and the 
anode current integrated while measuring tijne to reach a threshold 
level, then the tijne reconverted to light values by a division. 
The variables PUPX, PUPY, PUPRAD and PUBUCK are corrected once 
each cycle- The value of PUBUCK gives a criterion for whether 
the tracking is successful: if PUBUCK decreases below a minimum 
value, it is assumed the WITEAV point (Pi) has been outside 
the pupil image for too long, and that pupil track is lost (the 
switch PUPFND = for lost, +1 for OK), Bach time PUPTRX is 
entered the cycle count PUPCTC is incremented by 1. For the 
first 50 cycles (or whenever PUCHA ? 0) the test on PUBUCK is 
relaxed; it is assumed that the pupil has just been acquired and 
PUBUC K may not yet have reached its steady state value. A com- 
plete cycle of PUPTRK involves four vidissector points. These 
are indicated on the following pagei 
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Pi— -WITEAV p2 pl p3 < In the present program 

P2-~PAVAL * ' ' "black sense" is arbi- 

P3-PBVAL „ S 1 "? " l ^ "°" 

P4_PCVAL • M ValUe ' J 



In the previous version of the Oculoraeter the PUPIL track- 
ing loop described above was executed alternately with a corneal 
tracking loop. The same procedure is used in the present EYTRAK 
program and the few differences are relatively minor. In the pre- 
vious version corneal bucking voltage and corneal radius were 
manually-set constants. The corneal scan covered a full circle, 
i.e. CORNEA Y has two equal intervals, as did CORNEA X. In 
making the corneal scan discrete in the present program the pat- 
tern has been changed from a circle to an X-like pattern of five 
points, as indicated below: 



P5— CORVAL . P9/P5 

P6 —AVAL _jT 

P7 —-BVAL P6 . . ** . P7 

P8— ^CVAL 
P9^-DVAL - PS 



The corneal bucking voltage (CORBUC) is taken as the average 
value of CORVAL and WITEAV. The values calculated by CORTRK are 
CORAX, CORAY, CORX, CORY, CORRAD and CORBUC. CORBUC is tested 
against WITEAV except during the first 50 cycles (CORCYC < 50) . 
The scan radius is fixed. The time allotted by the program to 
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measure any point (Pi through P9) is not more than 194 sec per 
point, although the average total time consumed per point is 
approximately 300 sec because of program overhead. 

Oculometer Eye-Tracking program Flow charts 

Flow charts for the Oculometer eye-tracking program routines 
EYETRAK (Eye Track), PUPTK (Pupil Track), CORTK (Cornea Track), 
PUPGET (Pupil Get), and CORGET (Cornea Get) are presented on the 
following pages: 
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EYT3AK 



CYTRAKs 



MALGQ : 
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EYTRAK (continued) 

, L_ 

EXIT: ^ FASTSW = 



NO 



YES 




FAST 



PLAGE-* G 



T 



RETURN 



GGHAK: 



PUPFND— -1 
LOSTS—0 

BLINKS — 



< 



I 



CGRLQS : ( FASTSW 



— v* 



YES 




FAST 



TCT^TCT + 2 



^ TCT > 
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EYTRAK (continued) 
BLINKYj 




BLINK: 



BLINK 1: 



BLINKS-- -1 
G-— BLMAX 



BLINK2: 




< G > 



NO 



G — CMAX 




BLINK 1 
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EYTRAK {continued) 

( 



STIN-KY: ( PUSHJ PUPGET 



) 



STIMK2: 




I 



HO 



L0STS4--1 
BLINKS— 
A*-PUPX, ,PUPY 

f PUSHJ CIRINl) 

RINK*: Q~PUSBJ SPIRIT J 



TEM1T4— A 



< check 
hit 



if spiral has 
any boundary 



YES 



Initialize spiral 
mirror starch 



Get next X t ,Y mirror 
coord 



i 



NO 



^> W tQO BIG) 



TCT-*-TCT + 1 



T 
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BYTRAK (continued) 

* ^*0 

<^ TCT > TIMLIM J>-i 



VfiS 



MODE—1 




< 



r 


A— TEMIT 


1 


* 


c 


PUSHJ MIRRDC 


) 


i 


c 


PUSHJ PUPGET 


) 


* 



PUPFHD ■ 



TOOFAR; 



A — 


-HIRMAX 


B — 


MIRMAY 


c*- 


MIRXNC 


D--*- 


-MIRYNC 



J 



f PUSHJ RASXNZ J 
DINKY: f PUSHJ RASGEN J 



A — A + MIRZER 



c 



i 



PUSHJ MIRRDG 



I 



) 



f PUSHJ PUPGET J 
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send mirrors 



search for pupil 




last resort 
initialize mirror 
raster 



use raster generator 



EYTRAK (continued) 
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PUPIL TRACK 



PUPTK: Set up to read following points from vidiaaector 



PI: PUPX + PUPRAD/2 , , PUPY (+ if CORX < 0) 

P2 I PUPX-PUPRAD, , PUPY 

P3s PUPX + PUPRAD, .PUPX 

P4 : PUPX, , PUPY+PUPRAD 



WITEAV — (IP1-WITEAVJ/4 
PUBUCK --WITEAV/2 



WITEAV 



•EAV | 
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PAVAL--IP2 
PBVAL-*-IP3 
PCVAL-^IP4 



PUPY^ PCVAL-PUBUCK + pupy 
16 



I 



PU PX^ PBVAL-PAVAL +pupx 
lb 



T 



B- 



- PUBUCK *4+PUBUCK+PAVAL 



128 



I 



+PBVAL+PCVAI, ! 



< ^ PUCHA ._= ^ > 



PUPRAD ^ B+PUpRAD 



E 



<T PUPRAD > 



YES 



NO 



I P UPRAD «— 

T 1 



200 



PUPIL TRACK (continued) 



i 



YES 



PUPCVC = PUPCYC + 1 

I 




< PUBUCK < PUKMIN 



YES 



PUPFND — 



1 



Q RETURN J without skipping ■ 



error 



PQK: 



< 



PUPCYC 



100 p »(POKl ) 



YES 



^ (PUPCYC) AND (37) - 
1 YES 



NQ 




POKl 



send out PUPX, ,PUPY to mirrors 




AOS (P ) 
f RETURNj 



set for skip 
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CORNEAL TRACK 
CORTK: Set up to read the following points from the vidieeeetor 



P5: PUPX+CORX, , PUPY+CORY 

P6 ; CORAX-CORKAD, , CORAY 

P7i CORAX+CORRAD, , CORAY 

P8 : CORAX, , COKAY+CORRAD 

P9 : CORAX, , CORAY-CORRAD 



CORVAL — IPS 
AVAL ■*— IP6 

BVAL IP7 

CVAL IP6 

DVAL -. IP9 



CORAY 



CORAY + 



DVAL* CVAL 
16 



CORY — CORAY - PUPY 

BVAL-AVAL 



CORAX ---CGRAX + 



16 



CORX ««- CORMC - PUPX 



CQRRAD— CORRAD + 



CORBUC * 4 +A VAL+ BVAL+CVAL+ DVAL 



i 



make CORRAD at least 20 
and no greater than 120 



T 



56 



CORNEAL TRACK (continued} 



WITEAV + CGRVAL 



- CORBUC 



CORBUC — CORBUC + 



I 



CORCVC - CORCVC + 1 



I 



<^ CORCYC < 50 J^> 



YES 



i 



NO 



<T CORBOC - 40_ < WITEAV 



YES 



COR?ND*-0 
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PUPIL GET 



PUPGETi 



NEWBOW: 



NEWPT: 



RQWMAX — Q 



initialize raater scan 
over whole screen 



1 



WITESW — 
WITECT-*— 
BB1TSM— 




< B 4 



YES 



< ^ WITESW > ^ > 
YES 



<c 



i 



WITECT ^ PUPMIM 



I 



YES 



< ^ WITECT ^ RQWMAX 
YES 



I 




(intensity returned in 
in B. small ■ dark 
large = bright) 



WITEAV 



£JUTSM 
WITECT 



SB 



T 



PUPIL GET (continued) 



INPU; 



/newrotA 



BRITSM— BRITSM 


+ 


B 


WITESW— 1 






WITECT-*- WITECT 


+ 


1 


XROW-»ROSX 








PFINDi 



PUPRAD - 



WITECT* PUP INC 



PUPX-— XROW - PUPRAD 

PUPY *— ROSY 

PUPCYC —0 

PUPFHD — -1 

WITEAV 
PUBUCK — 5 



POUT: 
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CORNEAL GET 



CGRGET: 



PTSRCH; 



initialize for raster scan in 
square containing pupil 



i 



BRITLV -•- ' 



WI TEAVJRAT 
28 



11 



I 



CORMAX-*— 

e*-q 



I 



(PUSHJ ROSGEN J 

< £ RQSNO =- 
I YES 
f PUSHJ VID J 



NO 



A^QLRQS 



NO 



<^ B > CO RHAX y - 
YES 



I 



CORHAX -—B 
ROSBES —A 




RASDUN 
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CQRMEAL GET (continued) 



BASDUN; 



NOCOR: 



CQRBUC 



CORMAY + WITEAV 



CORAX — (ROSBES ) L 



CQRAV — (ROSBES 



I 



NO 



YES 



CORFND-* — 1 
CORRAD *-2Q 



CQRFHD-*- 



i 



CGRCYC 



i 



E r> 



C 



AOS (P) 

Z3Z 



RETURN 



") 



<^ CORMAX > BRITLVj> ** NOCOR 
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Calibration and Point of Regard Calculation 

The eye-tracking algorithm described above requires an 
outer loop to make use of the raw data it supplies for the pur- 
pose of calculating the subject's point of regard. Calibration 
permits the relationship to be established between the raw eye- 
track data and the point of regard. The point of regard is nor- 
mally construed to be located within the boundaries of the video 
display screen. Calibration is accomplished as follows, after 
the subject is properly positioned at the Oculometer and after 
the routine SCRTST has been completed and EYTRAK is operating i 

a) The calib routine presents five (5) points, PA, FB, PC, 
PDj And PE, in succession an the video display to the subject as 

indicated i 

• PC PB s 

X,Y video display 
^"horizontal field of view * 12. 5° 
vertical field of view ^9,5° 

b) The EYTRAK routine is then required to obtain sixty-four 
(64) consecutive measurement periods at each of the five (5) call* 
bration points. 

c) The sixty-four (64) measurements at each calibration 
point are averaged by CALIB to get one CORX and one CORY value 
for each of the five (5) points. 
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d) The CORX and CORY values are used by CALIB to calculate 
"0" offset values MXZ and MYZ. 

a) The values SCRMAX (maximum video display screen coordi- 
nates) and the averaged values of each of the pa, pb, PC and PD 
points are used by CALIB to calculate values MXR and MYR. 

f) The values PORX and PORY (values for point of regard in 
x,y coordinates on the video display) are calculated by CALIB 
using values CORX, CORY, MXZ, HYZ, MXR and MYR. 

Data Display 

After the routine CALIB has been successfully accomplished 
and the routine EYTRAK is running, the routine CIRC will display 
the subject's point of regard (fixation point) at the correct 
fixation position on the video display, 

A certain amount of smoothing of the displayed fixation 
point (to reduce fixation "jitter") is accomplished by using rou- 
tine IHTEG* This smoothing is obtained by doing a moving average 
of the last ten (10) values of BVTRAK output provided to CIRC. 

Other display features of the present Oculometer program 
are the routines REPLAY and DPYSUB. The former routine will 
replay (on the video display) the fixation point pattern of a 
subject developed during an eye-tracXing experiment. The latter 
routine DPYSUB will display all the old points of an eye fixation 
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pattern that the program has been instructed to save. 



DISCUSSION OF COMPUTER- CONTROLLED OCULOMETER 
SYSTEM PERFORMANCE AND APPLICATION 



Evaluation of System Performance 

The work reported here was primarily in the nature of a 
system feasibility study, i.e. the initial development of speci- 
alized computer-Oculometer eye-tracking/control programs and l/o 
interfaces for a prototype interactive eye movement tracking 
system. Because of this, the time allotted for quantitative 
evaluation of the system was minimal. However, the qualitative 
results were encouraging. Digital computer control of the system 
allowed Oculometer performance that was generally equal to, and 
in some instances superior to, the performance obtained with the 
previous analog-digital hybrid system control circuitry. An 
example of the improved performance capability of the present 
Oculometer system is its ability {unlike that of the previous 
system) to operate under well-lighted room conditions. This per- 
formance feature is a particular result of the present kytkak 
program and the integrator-threshold detector described elsewhere 
in the report. 
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During the development of the calibration program (CALIB) 
for the present system some quantitative information was obtained 
regarding values of fixation point {eye point of regard) random 
noise level and repeatability of measurement. These values, 
which are listed below, represent the video display output oE the 
system after the raw eye-track data has been smoothed by the 
moving average INTEG routine: 

aj Fixation point random noise level — 

For artificial eye (see Appendix C) s*£ 3/8° 

For human eye (subject fixated on static 



point on video display with head posi- 
tion fixed in holder) =3+ 1/2 



D 



b) Repeatability of measurement 
(human eye only) — 

Subject head position fixed in holder s*^ 1/4° 

Subject head position not fixed in holder ss^f 5/8° 

The above values (over horizontal and vertical fields of view 

of 12.5° and 9.5° respectively) are indicative only of the general 

performance of the particular Oculometer electro-optical unit 

used in th* present system, which employs a vidissector with a 

circular scanning aperture of approximately 20 mils diameters and 

a non sophisticated near— infrared optical subsystem. An Oculometer 

electro-optical unit utilizing a smaller aperture vidissector and 

an improved near- infrared optical subsystem (see Ref . 5) would be 

expected to provide even better performance. 
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System Demonstrations and Applications 

The success of the computer-controlled Oculometer system 
developed here shows the feasibility of developing a compact 
Oculometer system utilizing a small, dedicated, digital computer 
for Oculometer control ■ 

The applications of such a system appear to be many and 
varied. As an example, eye-tracking data developed by a compact, 
digital— computer— controlled Oculometer system could be used as an 
input to a large digital computer, as suggested by Geffner {see 
Ref . 6 and Appendix E) for large-scale interactive experimentation. 

Some other examples of Oculometer system applications, based 
on demonstrations performed during the accomplishment of this 
work, are as follows: 

a) Using the eye as a control devic e. In this demonstration 
(see Fig. 18) the subject's eye movements controlled the position 

of a "box" which could be made to overlay a "moving bird" target 
which moved with random acceleration in various directions. The 
movements of the "bird" would be minimized so long as the subject 
continued to eye-position the "box* over the "bird". 

b) Recording eye fixation point and exploration patterns * 
In this demonstration the subject's eye movements were monitored 
and displayed while he "flew" a flight simulator. The flight 
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Figure 18 OCUL0METER AS A CONTROL DEVICE 
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simulator consisted of a PDP-6 ccmputer (using a special program 
(see Appendix 0)) with an instrument panel displayed on its X,Y 
video display (see Fig- 19). A particular eye fixation point of 
the subject is clearly displayed on the video display below the 
center of the central instrument as shown in Fig- 20. 

c) Using the cyo in game playing . In this demonstration 
(see Fig* 21) a "ball* game was being played by two subjects. 
Two box-like "bumpers" , one of which was controlled by one 
subject manipulating a joystick and the other controlled by the 
other subject's eye movements, were independently maneuvered in 
front of the "ball* 1 so as to deflect it and cause it to cross a 
particular set of boundaries, thus making a score for one or the 

other player (see also Appendix E) . 

d} Using the eye in training machines and in psychophysio - 
logical testing * Demonstrations in these areas are explained 
and depicted in Appendix E* 



CONCLUSIONS 

The feasibility of using the digital computer technique of 
Oculometer control has been successfully demonstrated here in the 
development of a prototype interactive eye-movement tracking 
system. This technique is capable of providing the following 
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Figure 21 OCULOMETER USED IN GAME PIAYING 
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advantages: 

a) real-time analyses of data, 

b) interactive experiments, 

c) precision timing source, 

d) flexibility of experiments. 

e) improved eye-tracking accuracy by using predictive 
programs, 

f) new eye-tracking schemes by using program flexibility, 

g) improved system accuracy resulting from removal of 
nonlinearities by special programming. 

The results of the work described here seem sufficiently 
promising to warrant further development of both Oculocneter 
electro-optical subsystems and Oculometer eye- tracking/control 
programs, to be utilized with dedicated, compact, digital com- 
puters, which could be combined to form complete Oculometer 
systems. 
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APPENDIX A 
OCULOMETER EYE-TRACKING/CONTROL PROGRAM 

A digital computer eye-tracking control program has been 
written for the Oculometer. A listing of this program may be obtained 
fro* the M.I.T. Artificial Intelligence Laboratory/ 
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APPENDIX B 

IMPROVED OCULOMETER POWER SUPPLY 
AND NEAR-INFRARED LIGHT SOURCE 



Power Supply 

An improved power supply unit has been designed to accomo- 
date nearly any oculometer electro-optical unit (see Fig, B-l) • 
The design utilizes components selected for excellence of perform- 
ance, and no other criteria were used. Consequently, the unit is 
rather heavy, tut it represents a highly reliable piece of 
laboratory equipment. 

A transistor-relay fail safe circuit has been incorporated 
in the power supply unit to protect the vidissector deflection 
amplifiers in the event that the vidissector yoke coils have not 
been connected. The circuit has a series connection through the 
x and y yoke coil output connectors, and power will not be deliv- 
ered until these connectors are In place. Two pins have been 
clipped in each of the output connectors to insure that the yoke 
coils are connected before the relay is connected. Also, if the 
feailure of either supply causes it to go to ground level, the 
relay will open and prevent an unbalanced supply to the amplifiers. 

The deflection amplifiers incorporate a damping control to 
minimise overshoot regardless of yoke coil inductance. This control 
is adjusted with R, on the amplifiers. R 7 on the amplifiers adjusts 
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the DC level at the output. R 6 should be adjusted before R 7 since 
it will have an effect on the zero signal output current. 

Spurious oscillations occurred in the deflection amplifier 
outputs during the initial tests of the power supply unit. It 
was determined that this was due to the capacitive effects of 
the leads to the X and Y monitor outputs- A small resistor was 
placed in series with these leads at the amplifier to isolate 
the monitoring circuit from the amplifier. Capacitors were also 
placed between the outputs of the defelction supplies and power 
ground to eliminate any ripple that may be present there. These 
additions are included in the schematic wiring diagram of the 
power supply unit. Fig. b-1- 

Vidissector focus current is adjusted with a trimmer poten- 
tiometer at the top of the focus current regulator card {PR 1682) . 
A switch is also available on this card to switch the direction 
of the focus current. Once the switch position is selected, it 
should not be disturbed, since reversing it could damage the 
focus current ammeter (unless the ammeter connections are 
reversed also). 

Upon initial testing of the power supply unit, it was 
observed that a herringbone pattern was present in the video 
output of the vidissector during a test-raster display mode of 
operation. The focus current regulator was found to be the 
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source of the problem, and appropriate components were added to 
it to eliminate the aberrations in its output. The added ele- 
ments are illustrated in the focus current regulator circuit 

diagram (see Fig- b-2) by heavy, dark line drawing. 

The power supplies (LM-D-20-Y) of the deflection amplifiers 
are grounded at the power ground terminal of the amplifiers and 
at no other point. The BNC input connectors of the deflection 
amplifiers are floated off the panel face with insulators. This 
means that the ground level of the deflection circuit will be 
established at the signal source. All other power supplies are 
chassis grounded. 

The shield of the vidissector high voltage coax is chassis 
grounded and no ground connection snould be made to the body of 
the optical head. 

The wiring diagram of the vidissector in the oculometer 
electro-optical unit is included in Fig. b-1 for completeness. 
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Figure B-2 FOCUS CURRENT REGULATOR SCHEMATIC (MODIFIED) 



Power Supply Recommended Operating Values 

Focus Coil 150 ma 

Vidisaector High Voltage -2000 V 

Vidisaector DT - Qnd -1600 V 

Vidisaector DT - Dl V 

Vidisaector DT - D2 .36 V 

Vidisaector D9 - Gnd -265 V 

Vidisaector DlO - Gnd -119 V 



Power Supply parte List 



Power jiuppliea 

Electronic Research Associates, Inc. 

Model #LC3210 

4-32 VDC, 12,5a. & 35°C 



Quantity 



ACDC Electronics, Inc. 
Model #BX34D0.6-12 
+34 VDC, 0.6a. 



71°C 



Lambda Electronics Corporation 

Model #LM-D-20-Y 

20 VDC, 7.4a. @ 40°C 

Del ElectronicB Corporation 

Model #2.SHRM4N1 

1.3 KV - 2.5 KV • 4 ma. 
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Deflection Amplifier 

Celco 

Model #»-PP2N-7 

input ^2 V 

output +2 a 1 

Focus Current Regulator 

Beta Instrument Corporation 

Model #FR 1882 

20 ma. to 800 ma. 1 

Relay 

Potter and Brumfield 

Model #KRP 11 D 

coil - 5001* 

24 volts nominal 1 

Transistor 

PNP-2N2905 or equivalent 1 

Resistors 

30 kl), 1/4 W 1 

lo kn, 1/4 w l 

390ft, 1/2 M 1 

resistor as desired for high voltage 1 

adjustment (temp, coeff., 30 PPM or better) 

Connectors 

Burndy {box mount receptacle) 

Part #BT02-P-10SX 

10 socket contacts (#20) 1 

Burndy (box mount receptacle) 

Part #BT02-P-12-10SW 

10 socket contacts (#20) 1 
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Burndy (straight plug) 

Part #BT06-AC-12-10PX 

10 pin contacts (#20) 1 

Burndy (straight plug) 

Part #BT06-AC-12-10PW 

10 pin contacts (#20) i 

Burndy (box mount receptacle) 

Part #BT02-P-14-12SY 

12 socket contacts (4 #16, 8 #20) 1 

Burndy (straight plug) 

Part #BT06-AC-14-12PY 

12 pin contacts (4 #16, B #20) 1 

MHV high voltage connector 
(receptacle and plug) 
UG932/U . 1 

Banana jack (heavy duty) 4 

BNC jack (standard) 2 

Meters 

Simpson - Hide Vue 

Model #1327, 0*50 V 2 

Simpson - Wide Vue 

Model #1327, 0-500 ma X 

Simpson 

Model #29, 0-3000 V 

(with external multiplier) 1 

switch*. 



Arrow-Hart and Hegenian 

Model #82611 

DPDT - 15 A 9 125V 

Arrow-Hart and Hogeman 

Model #82609 

DPLT. 3 position, on-of f-on 
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Indicator_Lights 

Dialco 

Model #95-0408 



Lamps 

Model #NE-5lH 5 

Fuse Holders 

Littlefuse 

Model H372001 

SAG fuse extractor post 5 

Near-Infrared Light Source 
The Proximate Oculometer electro-optical unit light source 
housing has been modified to utilize an A.S*A. PCS tungsten-halogen 
lamp. This lamp replaces the original GE No. 1982 tungsten-halogen 
lamp. The FCS lamp has a close-wound, rectangular filanrtnt 
nominally 0.215 x 0.114 x 0.055 inches in size. It is capable 
of producing a more uniform illumination of the eye space than 
the former G.E. lamp. The FCS lamp is mounted in a Sylvan in 
TP-3 ceramic socket, attached to the lamp housing by two screws, 
and is easily replaced, unlike the previous Ian p which required 
wire-soldered connections. Although the lamp is rated at 
150 watts (24 V, 6.25 A), it is being operated at a reduced 
input of approximately 80 watts (16.5 V, *.g A). Provision is 
made on the lamp power supply (LC 3210) for changing the lamp 
input wattage* The lamp power supply is variable in steps from 
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4 to 32 VDC by connecting the proper terminal* on the bus at the 
back of the supply. Within each step the voltage is varied by 
achusting R 2 § located on the top of the supply. 

The lamp output is filtered by the original optical system 
filters ;'i and F~ to produce a near-infrared bean to illuminate 
the subject's eye at the eye space. The illumination baamspread 
ia approximately 1.2° as determined by the optical system aper- 
ture Aj and lens L_- (See Ref- 2, pp. 7, 14 and IS.) 

The nominal life of an FCS lamp is 50 hours when operating 
at rated wattage under recommended cooling conditions. An 
80-hour lifetime can be expected for the lamp operating at the 
80-watt level under the conditions found in the oculocneter lamp 
housing. 

When a lamp is replaced due to failure or aging (discolor- 
ation of the lamp envelope internally) the following procedure 
should be usedi (1) Remove the socket and the lamp fron the 
lamp housing? (2) remove the lamp from the socket? <3) replace 
the old lamp with a new one, being careful to keep the lamp 
envelope free of any contamination such as finger moisture or 
oils; (4) replace the socket with the screws (5) turn on lamp 
power and observe position of lamp filament in aperture A v . This 
is done by placing the eye at eye space. The lamp filament 
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should be centered in the circular aperture A . If it is not 
centered, remove the socket (with power off) and reposition lamp 
slightly in the socket* (6) Repeat steps (4) and (5) as often 
as necessary to secure proper lamp position in aperture A . . The 
above procedure insures uniform illumination at the subject's eye 
on the optical axis of the image dissector in the oculoroeter. 

AFPENDIX C 
ARTIFICIAL EYE AND MOUNTING DEVICE 

An artificial eye and an artificial eye mount were constructed 
to aid in the testing of the Oculometer system. 

The dimensions of the artificial eye, which was machined and 
polished out of rae thy line tha cry late plastic (n - 1.49), are shown 
in Fig. 0-1. These dimensions match closely those of the human 
eye and were found to be adequate in the use of the artificial eye 
assembly to relieve a human subject during tedious system adjust- 
ments and calibration tests. 

The artificial eye mount (see Figs- C-2 and C-3) was con- 
structed from a modified laser mirror mount, with the addition of 
protractor plates which are used to determine the horizontal and 
vertical eye angles. 
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APPENDIX D 
DIGITAL COMPUTER FLIGHT SIMULATOR PROGRAM 

A digital computer flight simulator program has been written 
for the M.I.T. Project MAC A.I. Group PDP-6 computer (see A.I. 
Memo 209, "Digital Computer Flight Simulator. " by D- Silver). 

The flight simulator instrument panel is displayed on the 
computer video display while the subject "flys rt the simulator 
with a joystick and a "throttle". The subject is presented with 
B%vn (7) instruments on the video display as follows: 

a) Gyro compass 

b) Air speed 

c) Artificial horizon 

d) Altimeter 

e) R.P.M. (power) 

f) Combination rate of turn/slip 

g) Rate of climb 

The mode of operation of the simulator is as follows: 

1) The subject manipulates the joystick with one hand, using 
three (3) degrees of freedom: 

a) left-right for aileron control, 

b) forward-backward for elevator control, 

c) torque movement for rudder control. 

2) The subject's other hand is used to control the "throttle" 
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in a push-pull motion. 

3) The subject is instructed to perform certain maneuvers. 
The output of the displayed instrument panel (viewed by the sub* 
ject) is a function of the maneuver performed. 

A listing of the digital canputer flight simulator program 
appears on the following pages; 
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APPENDIX E 
"THE OCULOMETER'* FILM NARRATIVE 

This film was designed to demonstrate the flexibility (and 
some possible applications) of both digital-computer-assisted 
and digital-computer-controlled Oculometer systems. 

The first scenes show the Proximate Oculometer, the first 
prototype Oculometer developed for HASA by the Honeywell Radia- 
tion Center- in this demonstration the computer is simply utiliz- 
ing the analog output (eye fixation data) of the Oculometer 
analog-digital hybrid circuitry. No computer control of the 
Oculometer is occurring. The Proximate Oculometer is set up in 
front of the computer video display and the subject views the 
display through the circular dichroic beamsplitter. Computer- 
generated words appear on the video display in French. As the 
words are fixated by the subject their positional coordinates are 
transmitted by the Oculometer to the computer, which translates 
them into their English equivalents and redisplays them. In addi- 
tion, the computer is programmed to vocalize the words as they 
are fixated and translated. 

The next sequence of scenes shows the Remote Oculometer. 
In these scenes the Remote Oculometer is being program-controlled 
by the PDP-6 computer through an l/o interface system and an I/O 
display-type terminal, unlike the Proximate Oculometer shown in 
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the previous sequence. The moving mirror head-tracking system is 
disabled here and the headrest is used to locate the subject in 
the field of view of the Oculometer vidissector. On the computer 
video display are seen images of the various control program eye- 
tracking patterns and program subroutine displays. 

The following scenes show the subject forming various letters 
by eye movements. The subject is tracking the end of a pointer 
which doesn't appear in the scene, it should be noted that the 
eye movements produced are relatively smooth pursuit motions. 
In the next sequence the formation of letters is attempted with- 
out the use of a pointer to folio*. The eye movements are not 
smooth, but rather are a series of saccadic jumps. 

The next scene shows the results of the subject's eye 
tracking a square pattern to provide some suggestion of system 
output linearity. The linearity depicted here proved adequate 
for a wide variety of simple demonstrations. 

For the demonstrations which appear in the following 
sequence of scenes a slide was projected on the video display 
(where the subject was fixating) and the subject (a male) was 
asked to look at the slide and formulate an answer to a question 
he would be asked. The first slide is of an attractive young 
lady and the question asked the first time was "Is this a ship's 
figurehead?" The subject scanned all the relevant features of 
the young lady and determined that the features were rather more 
IBB 



lifelike than a ship's figurehead. The fixation pattern is 
shown. Using the same slide the same subject was asked two more 
questions, "Is it a windy day?" and "Which direction is up in 
the picture?" The fixation patterns produced by the subject are 
shown for these latter two questions. Then the sequence of the 
three fixation patterns are replayed to show the differences 
thit exist. 

In the next sequence of scenes a new slide of a young lady 
is projected and three different subjects are all asked the same 
question, as follows: "What part of the country was this photo- 
graph taken in?" The scanning pattern of the first subject (a 
rather shy female) indicated a rather strict attention to terres- 
trial detail. The second subject (a male) indicated by his scan- 
ning pattern first an interest in the young lady in the photo- 
graph and then proceeded to scan the background for clues. The 
third subject (another male) showed little interest in the back- 
ground but much interest in the young lady, as indicated by his 
scan pattern. Thus, three different fixation patterns of the 
same object are displayed by three different subjects, which 
indicate differing approaches to the same visual task. 

The final sequence of scenes shows a simulated "ball" game. 
The ball is being served from up-down and from left-right. The 
object of the game is to deflect the ball across the proper 
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boundary using the bumper. The bumper with the horizontal bar 
is Joystick-controlled. The bumper with the vertical bar la 
eye-controlled by means of the Oculomotor. Left-right boundary 
crossing scores for the joystick and up-down boundary crossing 
scores for the Oculometer- The bumpers, to be effective, must 
be positioned in front of the ball, in the direction of its 
motion. 

N.B« Because of prohibitive reproduction costs one (i) copy 
only of this film is submitted with this report. 
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